What's new: A new pair of AI benchmarks could help developers reduce bias in AI models, potentially making them fairer and less likely to cause harm. The benchmarks evaluate AI systems based on their awareness of different scenarios and contexts. They could offer a more nuanced way to measure AI's bias and its understanding of the world. Why it matters: The researchers were inspired to look into the problem of bias after witnessing clumsy missteps in previous approaches, demonstrating how ignoring differences between groups may in fact make AI systems less fair. But while these new benchmarks could help teams better judge fairness in AI models, actually fixing them may require some other techniques altogether.